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Abstract 

We uncover a new kind of entropic long range order in finite dimensional spin glasses. We 

study the link-diluted version of the Edwards- Anderson spin glass model with bimodal couplings 

n . 

^ ' {J = il) on a 3D lattice. By using exact reduction algorithms, we prove that there exists a region 

of the phase diagram (at zero temperature and link density low enough), where spins are long 

"j^ , range correlated, even if the ground states energy stiffness is null. In other words, in this region 

twisting the boundary conditions cost no energy, but spins are long range correlated by means of 

^ ■ pure entropic effects. 
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The low temperature phase of frustrated spin models is a very interesting and debated 
subject l|. Especially in models with discrete couplings, lowering the temperature the frus- 
tration may produce surprising effects. For example, the classical "order by disorder" effect 
discovered by Villain et al. |2| shows up in 2D frustrated spin systems, where ground states 
(GS) have no magnetization, while a spontaneous magnetization is present at any positive 
temperature smaller than the critical one, < T < Tc (and this is a rather counterintuitive 
result!). In this case, the explanation is simple: due to the frustration, two subset of GS 
exist, having ferromagnetic and antiferromagnetic long range order respectively; these GS 
have exactly the same energy and so, at zero temperature (T = 0), they perfectly compen- 
sate each other, leading to null global magnetization; nonetheless, at positive temperatures, 
the energy of the ferromagnetic state is lower than the antiferromagnetic one and a long 
range (ferromagnetic) order is recovered. This example evidences the importance of exact 
cancelations at T = in frustrated models. 



E 



Among frustrated models, spin glasses (SGs) [3[ have a very complex low temperature 
phase. Entropy fluctuations in SGs with discrete couplings are known to play an important 
role and are most probably the main mechanism for making the free-energy spectrum gapless 
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In this work we study 3D spin glasses with binary couplings (J = ±l)atT = 0, showing 
that frustration in SGs generates an effect even more impressive than the one found by Villain 
et al.: a long range order only due to entropic effects. More precisely, in this entropically 
ordered SG phase, a typical SG sample has many GS with exactly the same energy, such 
that, summing over all these GS, no long range order is found in the system at T = 0. 
However, at a closer look, all these GS are not really equivalent and taking into account also 
the entropic contribution to the T = exact computation, we find that a subset of GS is 
dominating the Gibbs measure and thus leads to long range order in the system. 

In order to explain the entropic long range order with simpler words, we consider a pair 
of spins, (Tj and aj, at a very large distance, |^ — j| — L (being L the system size) and try to 
estimate their thermodynamic correlation (a^aj) at T = by computing the probabilities 
of being parallel or antiparallel, P[(7j = ±crj]. The method, which is typically employed, 
computes the GS energy at fixed (relative) values of ai and aj-. if the resulting GS energy 
difference |£'gs(o"j = ctj) —EQs{cri = —crj)\ (the so-called energy stiffness) does not grow with 
L the system is believed to have no long range order. But this conclusion is wrong! Indeed, 



even if i?Gs(c"i = "^i) = Ecs^cTi = —<Jj), the relative orientation of at and aj still depends on 
the number of GS, A/gs? with given values of ai and 0"^: 

¥[ai = ±aj] oc A/bslcTj = ±aj) oc exp[5'Gs(cri = ±(^j)] , 

where Sqs is the GS entropy. If the entropy difference |5'Gs(o"i = o'j) ~ 'S'gs(o"j = —<7j)\ 
grows with L, then |(crjcrj)| — t- 1 in the thermodynamical limit and the system shows an 
entropic long range order (the energy stiffness being null). Please note that the present 
entropic effect is taking place also at T = 0, while the Villain's "order by disorder" requires 
a positive temperature because it is due to an energy difference. 

We are going to show, by exact reduction algorithms, that such an entropic long range 
order exists in SGs with discrete couplings on regular lattices in finite dimensions. We 
consider a link-diluted 3D Edwards-Anderson model defined by the Hamiltonian H = 
— X]<ii> <^iJij<^ji where the sum is over all the nearest neighbor pairs of a 3D simple cubic 
lattice of length L. The couplings Jij are quenched, independent and identically distributed 
random variables extracted from the distribution 

Pj{J) = (1 - p)5{J) + I [5{J - 1) + 5{J + 1)] , (1) 

where p G [0,1] is the density of non-zero couplings. 

This model has a critical line in the (p, T) plane that separates the paramagnetic phase 
from the SG phase. It was already shown by Bray and Feng |5| that, while in a model 
with a continuous couplings distribution this critical line ends for T = at the geometric 
link percolation threshold pc P], for discrete couplings the paramagnetic phase does extend 
beyond pc, because of exact cancellations between positive and negative couplings. Let us 
call psG the critical value separating the paramagnetic from the SG phase at T = 0. A 
tentative estimation of psG has been provided by Boettcher J6| by considering the "defect" 
energy Ai^Gs between the GS energies obtained by swapping between periodic and anti- 
periodic boundary conditions along one direction. He found that for p > p* = 0.272(1) 
the variance of AEqs grows with L (the mean being null by symmetry) thus leading to 
a SG long range order. After the work of Boettcher the threshold p* has been identified 
with psG, but this is not generally true (as we are going to show now). In general only the 
inequality psc ^ P* holds. Recently in Ref. J8| the same model has been solved exactly on 
the hierarchical lattice, showing that T = computations can lead to misleading results. 



Indeed, while at T = the model shows a phase transition at p*, the exact solution at 
positive temperatures predicts a critical line in the {p,T) plane ending in (psG;0), with 
Pc < PsG < P* (strict inequalities hold). The right critical point psc is clearly sensitive to 
entropic effects, that are neglected in the computation of p*. The determination of the psG 
value can be done by simply considering first order corrections in temperature to the T = 
computations. Thus, in the rest of the paper, we are going to work in this T = O"*" limit. 

On a 3D cubic lattice the model can not be solved exactly and Monte Carlo methods are 
very inefficient at low temperatures. To determine the right critical point p^c, we are going 
to apply some exact decimation rules that reduce the system to a much smaller size, which 
can be then easily solved by numerical methods. 

We consider periodic boundary conditions in x and y directions, while spins in 2; = and 
z = L — 1 are linked respectively to two different external spins, with quenched, independent 
and identically distributed random couplings extracted from the distribution in Eq. ([T]). The 
addition of these external spins does not modify the thermodynamic limit but it is very 
useful: to check for percolation will be enough to find a path of non-zero couplings between 
these two external spins, while to check for the presence of long range order one can just 
measure the correlation between these two spins. So, in general, one will be satisfied with 
the computation of the effective coupling between the two external spins. 

Given that the model is link diluted, we can eliminate recursively weakly connected 
spins, generalizing what was done in Refs. p, |8|. In the original model couplings are T- 
independent, but, by decimating spins, effective couplings are created whose intensity will 
depend on temperature. If we want to find entropic effects, the first order correcting term in 
T can not be neglected, even studying the system in the T = limit. For infinitesimal T, we 
can write an effective coupling as J = sign(J)(|J| — TK) if J 7^ or J = TK if J = 0, where 
/ and K are the energetic and entropic coupling respectively. The choice for the relative 
sign is dictated by the fact that thermal fluctuations decrease the coupling intensity. Spins 
and bonds are decimated using the following 5 rules. 
Rl A zero- or one-connected spin is eliminated. 

R2 A two-connected spin a is eliminated and an effective coupling J12 is created between 
the two neighboring spins, ai and (72, satisfying the equation 

\ ^ „{Jlo-cri + J2cra2)/T _ A Ji2cri(J2/T 
a=±l 



for any choice of cxi and (T2. Expanding at first order in T the two members, we have for the 
energetic component 

and for the entropic component 

K,2 = K, if |/l|<|/2|, 

tanh(ifi2) = tanh(i^i) tanh(J'S:2) if h = h = . 

R3 Two bonds J^, and Jf- between two spins i and j can be replaced by an effective couphng 
Jij with components lij = 1}^ + If^ and Kij = K}- + Kf-. 

R4 A three-connected spin a is ehminated and effective couphngs are created between the 
three neighboring spins (Xi, (72 and (73, satisfying the equation 

E -^l°"°"l + -^2'^°"2 + J3°"°"3 . Jl2°"l°"2 + J23°"2°"3 + J31°"3°"l 

e T = Ae T ^ 

a=±l 

for any choice of (Xi, (72 and (T3. Expanding at first order in T the two members, and 
introducing the couphngs Jo = Ji + J2 + J3 and Jk = Jo — 2Jk with k = 1,2, 3, we get for 
the energetic components 

/i2 = ^(|/o|-|/i|- 1/21 + 1/31), (2) 

/i3 = ^(|/o|-|/i| + 1/21-1/31), (3) 

/23 = ^(|/o| + |/l|- 1/21-1/31), (4) 

and for the entropic components 

K,2 = \ (/(Jo) - /( Ji) - /( J2) + /( J3)) , (5) 

Kn = \ (/(Jo) - f{Ji) + /( J2) + /( J3)) , (6) 

/^23 = \ (/(Jo) + /( Ji) - /( J2) - /( J3)) , (7) 

where /(J) = \K\ + ln(l + e-^l^l) if J = and /(J) = sign(J)ir if J ^ 0. 
R5 A spin a of any connectivity is ehminated if the number rij of its couphngs with a non- 
zero energetic component (/ 7^ 0) does not exceed three {nj < 3). li i,j = 1, . . . ,nj index 
the spins connected to a by couphngs with / 7^ 0, and if k indexes the other neighbours (for 



which Ik = 0), then the new couphngs Jy are computed following previous rules, while the 
new couphngs Jtk = sign(Ji) J/,, i.e. lik = and Kik = sign{Ii)Kk. 

We have applied recursively the above five rules in the order they are listed: i.e., at each 
decimation step, we try to use rule Rl, and, only if it does not apply, we try to use rule 
R2, and if it does not apply, we try to use rule R3, and so on. The decimation process 
stops when it reaches a reduced graph where none of the above five rules can be applied. 
This reduced graph does depend on the order the above rules are applied (because rules R4 
and R5 increase the degree of neighboring spins), and the order we have chosen is the one 
producing the smallest reduced graph. 

If the couplings have a discrete spectrum then rule R3 may produce exact cancellations, 
thus leading to null effective couplings: this is the reason why psG > Pc holds in general 
for models with discrete couplings. Applying the above rules recursively it is possible that, 
starting with only energetic couplings, the final effective coupling has only the entropic 
component (the energetic one being null) . In this situation it is clear that entropic couplings 
are essential even in the T = limit. 

First of all we study percolation properties of the networks of I and K effective couplings 
that result from the recursive application of the above rules to all bond and spins (except the 
external ones, that we want to keep). We are mainly interested in the percolation thresholds, 
pI and pf, for the energetic and the entropic components. These percolation thresholds do 
depend on the set of reduction rules and increase if more rules are useqj. In Fig. [1] we 
show the percolation probabilities of the networks of / and K effective couplings for many 
different lattice sizes as a function of the link density p. By studying the crossing points 
Pli,L2 of these probabilities for sizes Li and L2 = rLi with fixed r (we use r = 3/4, 3/2, 2) 
we have been able to estimate the percolation thresholds p^ and pf through fits including 
the first scaling correction |9|: PL,rL = Pc + A^L"^^""'^, as shown in the inset of Fig. [H The 
resulting values are p^ = 0.26475(10) and pf = 0.25161(5). The value oi p^ is correctly lower 
than p* = 0.272(1), the threshold value where a positive energy stiffness emerges: the fact 
that pI and p* in general differ can be easily understood by considering the 2D EA model, 
which is clearly percolating, but has negative energy stiffness. Moreover p^ is lower than 
pI because the applied decimation rules leave the energetic component rational, while the 
^ The 5 rules that we use are all those that keep the interactions pairwise. Indeed decimating a 4-connected 
spin would produce a 4-spins effective interaction. 
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FIG. 1. Percolation probability for different lattice sizes L as a function of the link density p for the 
energetic (right) and the entropic part (left) of the effective couplings. Inset: the infinite volume 
extrapolation for p^.. 



entropic one may become real, thus leading to much less exact cancellations. Please note 
that p^ provides a lower bound to psG given that geometrical percolation of the effective 
couplings is a necessary, but not sufficient, condition to have SG long range order. 

In the thermodynamic limit, for densities smaller than p^, the energetic component I is 
not percolating and can not induce any long range order. Therefore, in the link density 
region p^ < p < p^, an eventual thermodynamic phase transition can be due solely to 
entropic effects. 

To search for such an entropic phase transition, we further reduce the decimated graph. 
For p^ <P <pii with high probability in the large L limit, the decimated graph is percolat- 
ing solely in K, while the / couplings form clusters of finite size (similarly to what happens 
in standard percolation below pc)- An example of the resulting graph after the decimation 







FIG. 2. On the left we show an example of the system after the decimation. Full lines represent 
couplings with / ^ 0, while dashed lines represent couplings with 7 = 0. The two /-clusters are 
enclosed in circles and are connected only by purely entropic couplings. On the right, the system 
is mapped on a Potts model where each variable represents an /-cluster. These Potts variables 
are connected by effective entropic couplings taking into account all the interactions originally 
connecting the /-clusters. Please note that our decimation rules always produce a reduced system 
with degrees not smaller than 4, but here we have drawn fewer lines for the sake of figure readability. 



process is shown on the left side of Fig. [2l where full (resp. dashed) lines represent couplings 
with (resp. without) a non-null energetic component /. The two circles represent what we 
call /-clusters, that is groups of spins connected by couplings with a non-null energetic com- 
ponent / (note, however, that inside these /-clusters also couplings with only the entropic 
component K may exist, as in the rightmost circle in Fig. [2]). The connections between any 
two different /-clusters have only entropic components. 

Our idea is to map the original problem to a smaller and simpler one, where the variables 
are the /-clusters, that interact only through entropic couplings, as in the right side of Fig. [2] 

Given that we are interested in the T = limit, each /-cluster must be in a ground 
state (GS) configuration. So, for each /-cluster C, we compute with an exact branch&bound 
algorithm all its Ac GSs. We introduce then a Potts variable tq for that /-cluster, taking 
values in [1, A/c]- We call {erf (re)} the GS configurations of the C cluster. 

Working at T = 0, the GSs are calculated by taking into account solely the energetic 
component / of the couplings. Afterward we consider also the entropic components K, that 
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give rise to two different interacting terms. K bonds connecting two spins in the same 
/-cluster produce a self-interaction term 

This quantity may bias the choice among degenerate GSs even in the T = limit. In the 
new Potts model, it can be interpreted like an external field acting on the Potts variable tq 
that may bias its value. 

K bonds connecting spins in different /-clusters generate the interaction between the 
Potts variables. This interaction depends on the configuration of both clusters, and so must 
be represented as a matrix 

The Gibbs-Boltzmann measure for the reduced Potts model is then 

/i({rc}) ocexp [Y,M''^' (rcrc) + Y.E'irc)] . (8) 

C,C' c 

It is important to note that this measure does not depend on the temperature, because 
entropic couplings have a linear dependence on T that cancels the 1/T term in the Boltzmann 
factor. The Potts measure in Eq. ([8]) is an exact effective description of the original SG model 
at temperature T = 0+, having much less variables and a smaller complexity with respect 
to the original model. 

In order to locate a possible SG transition, we compute the correlation between the 
external spins under the measure /i in Eq. ([8]). If the effective Potts model has a linear 
topology, namely each variable has at most two neighbors, we solve it exactly by the transfer 
matrix method (the probability P to have these "linear" systems is rather high: e.g., around 
the critical density psG, P > 0.9 for L < 24, P ~ 0.7 for L = 32, P ~ 0.6 for L = 36 and 
P ~ 0.2 for L = 48). Otherwise we use a Metropolis Monte Carlo method to sample the 
measure in Eq.dHl), and the equilibration of the Markov chain is not an issue given the small 
number of variables. Since the Gibbs-Boltzmann measure in Eq. (jH]) does not depend on 
temperature, one can think of it as that of a Potts model at /3 = 1. Thus, for equilibrating 
the corresponding Markov chain, we perform a simulated annealing from /3 = to /3 = 1, 
with steps A/3 = 0.1 and different cooling rates (100, 300 and 1000 Monte Carlo steps per 
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FIG. 3. Average of square (below) and absolute value (above) of correlations at distance L, for 
different lattice sizes, as a function of link density p. Errors are not larger than symbols. 



temperature). We checked that the average of the interesting quantities, Hke the correlations, 
does not dependend on the cooUng rate. 

For the very few samples that show percolation in the energetic components, we assume 
a correlation between external spins equal to 1. This approximation makes no error in the 
thermodynamical limit as long as p < p^. 

Being interested in a SG long range order, we show in Fig. [3] the average over the samples 
of the square and of the absolute value of the correlation between the external spins (which 
are at distance L in the original model) as a function of the link density p. This quantity 
should decrease with L in a paramagnetic phase, while it should grow with L if a SG long 
range order is present: thus the crossing point of the curves in Fig. [3] roughly identifies the 
critical density psc- Our best estimation for psG has been obtained by the finite-size analysis 
of the crossing points of the correlations measured in systems of sizes L and sL, that should 
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FIG. 4. Crossing points of data shown in Fig. [3] with sizes L and sL as a function of L ^. 



scale as 



Pcross(^, sL) = psG + BsL ^^"^ 



In Fig. m we show the values of Pcross obtained with s = 1.5 and s = 2, together with the 
best fits. In the abscissa we have used the scaling variable L~^ that provides the best joint 
fit to all the data shown in the figure. However the uncertainty on this scaling exponent 
is large given the very small spread of Pcross around psc for the sizes we have studied. Our 
final estimation for the SG critical threshold is psG = 0.25473(3). 

By studying the slopes of the data shown in Fig. [3] at the critical point psG as a function 
of the system size we have been able to obtain an estimation of the exponent u controlling 
the shrinking of the critical region and we get z/ = 0.9(1). This value for the u exponent 
does not coincide with the one measured at criticality for the undiluted {p = 1) or weakly 
diluted {p = 0.45) EA model, which is ut = 2.2 (the subscript T should remind us that 
this exponent is related to the shrinking of the critical region in temperature). However a 
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FIG. 5. A schematic phase diagram in the (p, T) plane, showing that entropic long range order 
must exists also at positive temperatures. The dotted curve is the critical line of a model with 
quasi-discrete coupling. 

simple argument gives the connection between the two exponents: if the critical line close 
to the T = fixed point behaves like Tsg(p) oc (p — psc)'^, then I/vt = (p/^- Our results 
thus suggest a value ~ 0.4 for the shape of the critical line. 

We have shown that in 3D spin glasses frustration and coupling discreteness may induce 
an entropic long range order: in this phase the energy stiffness is zero (i.e. boundary condi- 
tions can be changed at no energy cost), but the states with largest entropy dominate the 
Gibbs measure. This dramatic effect of entropic contributions to the Gibbs states has been 
extensively studied in mean-field models of spin glasses with finite connectivity at T = 0, 



especially in the contest of random constraint satisfaction problems 10l-ll2[| . However in the 
present work we have proved the existence of such an entropic phase in a 3D spin glass model. 
Moreover this entropy dominated SG phase should persist also at positive temperatures as 
long as p < p* and the energy stiffness is null (see Fig. [5]). 

One may question that perfectly discrete couplings are difficult to find in Nature. 
Nonetheless if one considers a model with quasi-discrete couplings (e.g. integer values 
plus a small Gaussian term of variance a^ ^ 1) the critical line looks like the dotted curve 
in Fig. [5j it mainly follows the critical line of the corresponding model with discrete cou- 
plings and only for T < a moves towards pc- It is clear that the identification of such a 
critical line is based on the correct estimation of psG in the model with discrete couplings. 

One more comment about the generality of our results, regards what happens when 
couplings have a ferromagnetic bias. Indeed perfectly symmetric coupling (i.e. with a null 
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FIG. 6. Conjectured phase diagram at T = O'^ by varying the level of frustration (p in the model. 
The entropically long ranged phase should exist for any frustrated model, <y9 > 0, with discrete 
energy levels. 

mean, Jij = 0) are again difficult to find in Nature, and it is important to check whether 
the entropic long range order is stable with respect to the addition of a ferromagnetic 
bias in the couplings. The answer is contained in the pictorial phase diagram shown in 
Fig. ini where the link density p is reported as a function of some degree of frustration if. A 
quantitative measure for ip on a regular lattice can be, for example, the fraction of frustrated 
elementary plaquettes: ioi if = we have a pure ferromagnetic model, while for ip = 1/2 
we have the spin glass model studied in this work. In this phase diagram, the addition of a 
ferromagnetic bias in the couplings corresponds to reducing the value of ip with respect to 
the value if = 1/2 it takes in a spin glass model with symmetrically distributed couplings. 
The phase diagram shown pictorially in Fig. |6] contains, in general, three different phases: a 
paramagnetic one (P), a spin glass one (SG) and a ferromagnetic one (F). Moreover, along 
the SG-F boundary a mixed phase can exist [iSj, containing a diverging number of states 
with a non-null magnetization (but here we do not want to enter the long-standing debate 
about the nature of the spin glass phase in 3D models). In Fig. [6] the gray region is our 
educated guess about the location of the entropically long range ordered phase: in other 
words we conjecture the presence of such a phase in any frustrated model {if > 0) with 
discretized energy levels. 
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An important comment regards the implications of our results on the studies of the low 
temperature phase of SG models made by means of GS computations. In these numerical 
studies one or few GS are usually computed per sample, under different boundary conditions, 
and only the GS energies are considered. Unfortunately this kind of study is not able 
to identify the entropic long range order. In light of our results, this kind of numerical 
studies should be modified either considering the first order correction in temperature when 
decimating the variables, either computing many (or all) GS per sample, such as to identify 
the state which is entropically dominating. Some steps in this direction have been already 
taken in [ij], where it has been recognized that a correct estimation of the GS clusters 
entropy is necessary to extend predictions at positive temperatures. 



Last, but not least, the present best estimation for the 



Is 



ower critical dimension in SGs, 



di ~ 2.5, is based on GS energy stiffness computations [6|, which ignore entropic effects. 
Most probably this result need to be modified to a lower value due to the entropic long range 
order. 
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